# Chinese pre-training

ChineseBERT is a Chinese pre-trained model that integrates glyph and pinyin information, optimized for Chinese text processing.

LERT is a linguistics theory-driven pre-trained language model designed to enhance model performance through linguistic knowledge.

This model is a fine-tuned version based on hfl/chinese-bert-wwm on an unknown dataset, suitable for Chinese text processing tasks.

A medium version of the Chinese RoBERTa model series pre-trained by UER-py, trained on CLUECorpusSmall corpus, suitable for various Chinese NLP tasks.

BERT model pre-trained on 300G Chinese corpus using MLM, POS, and SOP tasks

A lightweight intelligent pre-trained model based on a 300G Chinese corpus